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CIMS Evaluation Attachment 


® This attachment contains a checklist of information that Ultra- 
systems requires in finalizing the- research design for the 
Evaluation and Analysis of the Job-Client (cleft) Matching Project, 
Contract No. B2C-5415. The checklist is intended to serve as an 
advance notice to define the scope and intent of the initial visit 
to your agency to be made by Ultrasystems in conjunction with the 
OEO Program Evaluation Officer during the week of July 24th. 


® This checklist is not a request for the actual data, but rather 
a checklist to provide Ultrasystems with a detailed definition 

of what the available data is in terms of format, content, ] 

media. The collection of the available data will occur later s ; 

in the project. a 


The checklist covers the following major categories: 


1) Determine the content, format, and availability of data “4 
recorded on each client and job that is part of the Cleff 3 J 
experiment including those in the Control Group. oa 


2) Determine the manner in which the experiment is being con- 
ducted by your agency, particularly with regard to transi- 
tioning between the Cleff System and the traditional place- ğü 
ment process. f 


3) Determine the organization, staffing, and functions of each 
Í agency, particularly as they relate to the Cleff Job Matching 
System experiment. 


| If you have any questions concerning the nature of the data being 

i j - sought, please call Mr. Stanley Nathanson, Project Director, 3 

| CIMS Evaluation Project, c/o Ultrasystems, Inc., Newport Beach, he TA 
| 


California, at 714-644-4100. 


Checklist 


I. Data Related To Client Applications, Job Orders, and Referral/ 
Placement Activities 


1, Copies of all forms used in conjunction with the placement 


P 


w 


process: 
1) Client Application’ 


2) Client Self Interview Checklist and instructional 
material (if any). English and Spanish versions. 


3) Job Order Form(s) 
4) Job Outline Checklist 
5) Training Opening Form(s) 


6) Forms used to record referrals including referral 
(client) introductory card 


7) Referral verification forms, e.g., employer mail-in 
cards, applicant mail-in cards 


8) Forms used to validate status of orders 

9) Forms used to validate status of clients 

How are files organized and purged? 

a) Client files 

b) Job Order files 

What data on clients, job orders, referrals, and referral 
results is furnished to ADP Personnel Data Systems and/or 
0E0? (Please provide samples of such data or reports.) 
How often are these furnished? 

How is this. data furnished? 

a) Original hard copy 

b) Assembled in report format 


c) In computer readable form, e.g., keypunched cards or 
mark sense forms 


Checklist (continued) 
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Data Related To Conduct Of The Experiment 
1. Who codes the Job Outline Checklist? 


2. Do you have a computer terminal for the submittal of the 
Client and Self Interview Checklist and the Job Outline 
Checklist and the receipt of the client-job matches? 


3. What are the dates that mark the beginning and end of 
each phase of the experiment, i.e., the 3 Control Group 
phases and the 3 CJMS phases? 


4. What happens to clients originally entered into the 
Placement process under the Cleff Job Matching phase as 
regards referrals when the CUMS is "turned off" 


_5. While the Cleff system is operating, are referrals to 


job openings or training being made independent of the 
Cleff system? 


If so, why, and for whom? 


Are job orders obtained during a Cleff phase carried 
over for use in the traditional placement process during 
the Control phase? 


Are all job orders on hand during the Cleff phases 
entered into the Cleff system? If not, what is the 
criterion for inclusion in the Cleff system? 


~ 


Was there any selection process used for choosing clients 
i aff Joo Matching 
If so, wh P is this selection process? 


© 


How are job orders obtained? 


a) Employers call them in 
b) Developed through employer contact by agency staff 
c) Furnished by governmental agencies 

Other 


9. Is there a relationship between the job openings being 
sought and training programs, e.g., job pledges developed 
for training program graduates? 


cals Cl x. 


Checklist (continued) 
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b. 


Are job orders obtained by other agencies participating in 
the Cleff experiment available for referral, by your 
clients? 


What happens to clients whose job adjustment index is 
below the cut-off point? How are these clients handled in 
the placement process? 


What happens to clients. whose suitability indices fall 
below the cut-off point and so do not obtain Cleff job 
matches? 


Agency Organization Staffing and Functions 
How many personnel are in your agency? 


How many are directly involved in the placement process, 
e.g., interviewers, counselors, job developers, etc.? 
Please list by job duty or titles. 


How many of your personnel have been involved with the 
Cleff Job Matching experiment? Please list their names, 
job duties, and length of experience (in years) with your 
agency. 


What are the basic functions performed by your agency? 


e.g., Placement 
Training 
Counseling 
Outreach 
Other (please list) 


What, if any, are the selection criteria’ used for determining 
the type of clients your agency provides services to? 


